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HOW A SKEPTIC MISREPRESENTS THE 
RESEARCH WITH STEPANEK 

A REVIEW OF MARTIN GARDNER’S 
HOW NOT TO TEST A PSYCHIC 

By Jurgen Keil 




I’V The following is a brief review of Martin Gardner’s book How 
got to Test a Psychic 1 and a refutation of his explanation for the suc- 
cessful experiment that Pratt had selected as providing the best evi- 
dence for ESP from the research with Stepanek. 
p Martin Gardner calls himself a skeptic. Skepticism has an honor- 
,able tradition, one that suggests uncertainty particularly about one’s 
’|wn favored views. Gardner repeatedly pays lip service to this tra- 
dition. Nevertheless, readers of his book may be forgiven if they 
(include that Gardner has a closed mind about the question of ESP 
nd other paranormal phenomena. The whole purpose of his book 
IS to misrepresent a period of careful research. Perhaps Gardner 

uld be called a pseudoskeptic, but this is for the reader of his 
k to decide. 

I! Gardner’s book is littered with terms such as ridiculous , laughable , 
weposterous, and so on when he tries to denigrate the research that 
gas carried out with Stepanek. Gardner complains that Ryzl did not 
[mention the name of an assistant in one of his publications but has 
|p) qualms about his own reference to a perhaps imagined “un- 
pamed parapsychologist who was always suspicious of Stepanek” (p. 
Ell.) nor about claiming success in preventing trickery by unnamed 
ratertainers (p. 256). Gardner repeatedly refers to psi research not 
|2^ e< l Stepanek, claiming that definite nonparanormal explana- 
Eg|hS have been found when in fact the questions remain open. For 
nstance, in experiments with Ted Serios, overexposed white pola- 
11^ prints ( whities ) cannot be readily explained except through 
Buipment failure, and, under some conditions, this is also the case 
§|“blackies.” Yet such prints frequently occurred when Serios at- 
pjnpted psychic photography. Gardner did not mention either that 
pndi never took up Eisenbud’s $10,000 challenge to produce struc- 

8^ New York: Prometheus Books, 1989, 264 pp. 
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tured prints under the same conditions under which Serins suc- 
ceeded. Gardner presents Honorton’s observations of Felicia Parise 
(pp. 189, 245) as if we now have evidence that Parise used trickery. 
With permission from Honorton (personal communication) 1 quote 
from Honorton’s letter of January 24, 1990. 

I have never had any grounds for changing my opinion of Felicia Par- 
ise. I remain convinced that her phenomena were genuinely anomalous 
I cannot eliminate the possibility of an explanation based on some kind 
of bioelectrical effect, but I am convinced that the phenomena were not 
produced through trickery of any kind. Nevertheless, as I stated in my 
PA presentation on Felicia’s apparent macroPK (with qualifications be- 
ginning in the title of the paper), we were never able to observe the 
phenomena under adequately-controlled conditions, and so the case can 
only be regarded as suggestive. 

With a fixed “mindset,” to use one of Gardner’s terms, that appar- 
ent ESP results must be due to trickery or errors, it makes sense to 
regard research as poindess if a subject does not succeed under con- 
ditions favored by the experimenter. If ESP as a possible explana- 
tion is taken seriously, then it makes a good deal of sense to con- 
tinue with experimental conditions under which a subject can obtain 
significant results provided safeguards can gradually be improved to 
a point where alternative hypotheses can be rejected with a consid- 
erable degree of confidence. The close proximity between Stepanek 
and various targets has been regarded as a problem by all research- 
ers who worked with him. In one of our papers (Keil & Pratt, 1969), 
we stated: “It must be admitted that the subject’s significant perfor- 
mance has so far been limited to a fairly narrow range of conditions, 
and this fact has made the exclusion of possible sensory cues far 
more difficult than it would be in another test situation (for exam- 
ple, one where subject and targets are situated in separate rooms). 
An attempt will be made to describe the test conditions in sufficient 
detail to enable the reader to form his own judgment with respect 
to [this] hypothesis . . .” (p. 256). It is interesting that at the end of 
his book Gardner states: “There are in fact just two possible inter- 
pretations. Either Pavel Stepanek was a remarkable psychic, with all 
the powers that Ryzl and Pratt and others attributed to him, or he 
was a clever performer who deliberately boosted his scores by non- 
paranormal means” (p. 257). 

It can be shown that Gardner’s explanation of how Stepanek 
could have produced the results as a “clever performer” is based on 
the false presentation of data from publications that Gardner cites 
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I his sources. Beloff (1990) in his review of Gardner’s book states: 
n some respects this is an exemplary treatise” (p. 171). Beloff was 
ipressed because Gardner apparently had consulted the relevant 
erature about Stepanek. I have some sympathy with Beloffs im- 
ied condemnations of critics who do not even bother to read rel- 
ant publications. In many ways such authors make it obvious, 
°ugh, that their purpose is to debunk some research because of 
me rigidly held views or because they think it is the only way they 
n make a living. I find Gardner’s pretense of detached, careful 
vestigations much more reprehensible because his misrepresenta- 
>ns and use of false data will not be apparent to most readers. 

Readers unfamiliar with research in which Stepanek participated 
er approximately ten years need to be briefed on how the exper- 
ents were conducted. Pratt in his monograph (1973) referred to 
o experimental reports that to him presented the best evidence 
r ESP because alternative hypotheses could be rejected with con- 
erable confidence: the Blom-Pratt study (1968) and the Pratt- 
il-Stevenson study (1970). Out of 258 pages Gardner devoted 4 
ges to the former study and 8 pages to the latter. As one of the 
thors of the three-experimenter study, I shall restrict myself to a 
cussion of this experimental report and to some other experi- 
:nts that are related to it. My brief introduction to the experimen- 
procedure is therefore limited to details that are relevant to ex- 
riments carried out in this relatively late period. 

During these experiments Stepanek used a binary code (white 
1 green) with which he responded to and identified (to a statisti- 
ly significant degree) a set of, for instance, four flat targets con- 
led in a set of four flat containers. Stepanek could usually see the 
itainers, and to a limited degree he was allowed to handle them, 
e targets were arranged (with the help of random number tables) 
h that for each presentation of a set of targets the order as well 
the sides (that is, which of the flat sides was on top) were ran- 
nized. 

When research was originally started, Stepanek was asked to call 
colors of concealed cards that were white on one side and green 
the other. The colored cards were concealed in opaque envel- 
s. Later the envelopes themselves were concealed in cardboard 
ers. They in turn were concealed in double-layered manilla card- 
rd jackets, and the jackets were eventually concealed in book- 
ling bags, also known as “Jiffy” bags. Inside each cover target 
tally concealed in a jacket) an envelope with a colored card in- 
: was normally enclosed. But during most of these later experi- 
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^Figure 2. Gardner’s Figure 2, reprinted with permission of Prometheus 
Books. 

as with respect to the top or bottom positions of the flat target sides. 
She same kind of randomization was also carried out when jackets 
Were used as containers. When book-mailing bags served as con- 
tainers, the order of presentation was randomized, but the mailing 
gs were always presented with the same side up. 

Although Gardner points out that “it is ridiculously easy to iden- 
fy the visible containers” (p. 128) this, at least for the later exper- 
iments, is quite irrelevant to the ESP question because even if Ste- 
panek remembered, for example, the eight sides of four jackets or 
|0 top sides of 20 book-mailing bags weil enough to recognize each 
i of them when they were presented to him again, this would not 
ave helped him to identify the concealed targets. Gardner acknowl- 
dges now and then that the experimenters were well aware that 
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visual cues on .he containers could 
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igure 3. Two frames from a 16-mm film. The experimental procedures 
ecorded on this film agreed with those carried out during experiments of 
his kind. The film was not taken during an actual experiment. On the first 
rame, Pavel Stepanek (visiting Charlottesville in 1968) is facing the camera 
tnd J. G. Pratt. Three containers (jackets) are stacked on the table near 
tepanek’s left shoulder. He has moved the first of the four containers to 
e right and is just about to put it down. The containers remained in a 
orizontal position. The second frame shows Stepanek moving the second 
'ontainer. 
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ends of book-mailing bags. In bis «a. to Figure J <°^ k P m S 
r^rrlner claims that the jacket targets concealed in the book, mai g 
baes came within a half inch of the opening of the mailing bags 
during The Series 23 experiment, .ha. is, during one of .he exper- 


during the series to cApcimiu.w, * 4 

iments published in the three-experimenter report hat Iran 
listed as providing the best evidence for LSI (1 ratt, 1973). 

Gardner’s statement is false. In the same publication we pointed 
oof “The size of the bags [book-mailing bags used as containers or 
°he .ale's such tha.Ve ends of .he jacke<s urge.s - .h,s 
experiment] when they are inserted all the way into the hap .by J. 

K are several inches below .he ends of the bags themselves (p. 29). 

In another publication (Pratt & Keil, 1969) that ts also cued by 
Gardner as one of his sources for his book, we e ' e " ‘ 
surements: “The book envelopes [standard No. * J J f 1 
were 14(4 inches long, while the jackets were 10 n^hes long. Whe 

the Jackets were inserted into the containers by J. K„ he was careiu 
the jackets were i ^ ^ ^ bottom of the envelope. When 

Ihis P was done the wo sides of the Jiffy bag at the open end came 
completeh^back together again. Thus there was a distance of at least 
4 inches between the open end oUht ^ an « We 

KoTt s because they IL jus. wide enough (inside 

ing movement of f have required very 

long^fingersT tomhTTedges of the concealed jackets. (See Fig- 

“"m presen! 1 have only one U S. No. 3 book-mailing bag of re- 
cent origin (Figure 4), which is almost ■/. of an inch shorter than the 
14./2 inches quoted above. Nevertheless, when one : of the or gmj 
jackets is inserted, the distance railed 

Offiaf Products 1990 (available in Charlottesville, VA) the length « f 
TL J mailing bag is listed as 14(4 inches. When we referred to 

various Lk-maL/bags that were used in 5 
ries we listed the Nos. 3, 4, and 6 bags as 8 x 14 , 9 xlS, ana 
X 18* (Keil & Pratt, 1969). These measurements were given as 
rounded figures only. The No. 3 bags measured in 1968 were 4* 
inches long and did not show any noticeable variations when y 
were stacked with others, but some may have varied slightly as the 
recent bag of approximately 14% inches suggests. These small vana- 








re 5. Even with a finger fully extended (compared to Figure 4 and 
dners Figure 7) the target cannot be reached by touch. 
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figures 6 and 8. Recent photographs of a No. 3 book-mailing bag. These 
hags remained in a horizontal position when they were moved by Stepanek 
m/a way similar to when the jackets were moved in Figure 3. The unsuc- 
cessful attempt to touch the target (unsuccessful because it cannot be 
Beached) is obvious, not only because the position of the hand in front of 
She mailing bag (as viewed by Pratt and Stevenson) cannot be concealed but 
gTso because the long mailing bag has to be handled in an awkward and 
Hmusual manner. The latter is less obvious in a still photo. 
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Figure 7. Gardner’s Figure 7, reprinted with permission of Prometheus 
Books. 


would be moved within 1 or 2 inches of the opening. This sugges- j 
don cannot be reasonably accepted as even a remote possibility. The j 

distribution of calls in Series 23 of 

dons shows that Stepanek had to recognize targets and had to m 
appropriate calls more than 30 and possibly 40 times to achieve the 
significant results that he obtained (Pratt, Keil, & Stevenson, 1970 
p S 30) Stepanek responded significantly to only some of the eig 
target skies. To others his responses were in agreement »» * 

would be expected by chance. The results from Ser.es 23 mdjcam 

that Stepanek responded significantly to three sl ’ T 

one further side but only by chance to the remaining four. Since 
the targets and mailing bags were randomized after each presenta^ 
don of a set of four different targets (i.e., of eight sides), Stepanek 
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|Figure 9. A recent photograph of one of the original jackets. The target is 
|tpiiched from the side. Even though this does not require the positioning 
19? hand m fron t of the container as in Figures 6 and 8, the deviation 
|ff om normal handling (see Figure 3) is still obvious. During some successful 
^series in which jackets were used as containers, the flaps were taped, that 
jls, the possibility of touch from the sides was prevented. 

HR* 


pvould not only have had to poke his finger into 30 to 40 mailing 
|bags but even into more to find those three or four marked target 
|ldes that he could recognize by touching their concealed edges with 
inis finger. Furthermore, to conceal the initial manipulation (i.e., that 
p® managed to position the targets within 1 or 2 inches of the open- 
phg of the mailing bag) from Pratt (who recorded the targets after- 
wards), Stepanek would have had to push the targets back into the 
flailing bags well beyond the reach of his finger. 

E A cinemagraphic film taken in Charlottesville in 1968 at the time 
when research reported in the Pratt-Keil-Stevenson study (1970) 
pas carried out shows Stepanek s handling of four jacket containers 
|hat concealed four cover targets. The film included four sequences 
(luring which Stepanek made four calls (i.e., a total of 16) and 
moved four jackets (one at a time) in a horizontal position. Stepa- 
nek’s handling of the book-mailing bags (with jacket targets)— not 

^hown on the film— occurred in the same way as his handling of 
jackets. ° 
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The film was not taken during an actual experiment but the ex- 

.1 nmredures were followed in every detail. The time se 
pcrinienta | n o ed , ye doscly lo the time sequences of 

quent.es o it jackets as well as with book-mailing bag con- 

I he experiments with jackets, as we recorded on film, 

tai tiers. When Stepanek made the 16 call tha, record 

he handled each container muched the first of the 

(measured from t e m ome the last one) was approximately 

(our containers until he put a . T identify a 
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“;=ld"he ^ok-maiiing bags convenience, ' buc wich a snug 
fic ch* allowed no sliding naovemen. 

were handled in the testing procedure. To explai y 

U .U„A Sipnanek would have had to manipulate the bags ana 
this method, Stepanek woma ^ ^ ^ when a 

:S2=sS“» 

^^The^udro^of ^^chre^^x^rimenler'scudies and 

ical puzzles and ocher publicacions, and ,n some ways he muse b 

, , am indebted to John Beloff for his suggestion to estimate the time span within 
whic!, Stepanek wo J have had to carry out such manipulations. 
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reasonable man. The closest parallel I can see is in my memories of 
some Southern U.S. politicians whose speeches I heard for the first 
time in 11)61/62. Some of these politicians were perfectly reasonable 

■ people when they spoke about various topics, but when racial ques- 

■ dons were discussed, something strange seemed to happen and their 
otherwise normal intelligence seemed to be misdirected into small as 
t well as obvious fallacies. Sometimes such behavior is referred to as 
|an encapsulated neurosis, and instead of presenting evidence of why 
psi ought to be taken seriously by pseudoskeptics who have such 
symptoms, we perhaps ought to spend more time on recognizing 
such symptoms because without treatment reasonable communica- 
tions will not occur. 

Gardner referred to Schroeder and Ostrander’s book as a pot- 
oiler. Gardner’s book fits into the same category. Unfortunately, 
oth books will be enthusiastically endorsed by all those who have a 
closed mindset. Published by Prometheus, Gardner’s book is assured 
pf a good sale; never mind that his main argument is based on the 
false presentation of data. 

I would still recommend that various parapsychological groups 
^Obtain a copy of the book to compare Gardner’s claim with my brief 
eview and with the original publications. It is very likely that for 
any years to come pseudoskeptics will repeat Gardner’s false 
claims that he has found a satisfactory nonparanormal explanation 
Or Stepanek’s results. 

A brief note should be added about Pavel Stepanek. Gardner 
paims that Stepanek had material benefits from his involvement in 
tiiis research. In a way this is true, but his benefits were quite mod- 
est and they were not of vital importance to his simple lifestyle. I 
lieve Stepanek was motivated above all by a friendship that he felt 
or Gaither Pratt and to a lesser extent for others. Whatever the 
dgments of various readers may be, Stepanek cannot be put into 
e same basket as Uri Geller. 

Stepanek refused to answer some questions that Gardner put to 
in a letter, and Gardner presents Stepanek’s refusal as an in- 
Jation that he has something to hide. Stepanek had been deeply 
fsappointed about promises that were not kept and about people 
' >se behavior he regarded as selfish or immoral. In 1971 I wrote, 
tepanek is an extraordinarily sensitive man who treats any com- 
tments between human beings with utmost seriousness. Some of 
major disappointments seem to be associated with human rela- 
ships where others disregarded or misinterpreted his very defi- 
te expectations” (Keil, 1971, p. 80). 
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'Those who know the details of some of his disappointments 

zr:':r ' 'z r ^ 

inrlicipated in any ESP experiments and was asked questions about, 
Im cxam^e his previous work in the library, his reacons to such 

* tr^and emotional responses can be regarded as 

extraordinarily sensitive. Although no conclusive statements can 
m x r w d Zut y detailed medical — 1« sue ~ 
tinns would only provide indirect evidence after 20 years or so 

“ s^l ^a»ca, 

ss r " 

('used '[tv'm'a't lessons anil other work that required ™ anl P ul ?“™ 
skills throughout his school life. This is clearly indicated in his high 

^ our 'personal relationships with public entertainers like Uri 
Ge, " nerhaps we should publicly adopt the view from the very 
^glnningdrauhey are determined to deceive us. Our experiments 
procedures in the work with Slepanek did not permit the kind of 
proced Tardner imagined. Unless someone can suggest a 

S’ without making false claims about 

he experimental conditions under which Stepanek was successful, 
ttmnaJe? wto never promoted himself and who never showed any 
8 g„ P , of deT£ r«e deception, ought to be treated with respect and 

gratitude for his long cooperation. 
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CORRESPONDENCE 


To the Editor: 

Permit me a brief reply to Keifs hatchet review (in the June, 
1990, Journal of Parapsychology) of my book about Stepanek. I did 
indeed fail to notice that in one test, out of many, the jiffy bags were 
larger than I realized, making it impossible for Stepanek to touch 
the target with a fingertip. So far as I know, this is the only factual 
error in a book containing thousands of details. Keil plays up this 
mistake as though it is characteristic of the entire book. Actually, it 
concerns only a minor test, which is described so briefly that we 
know nothing about the conditions under which Keil administered 
it. 

On page 157 Keil publishes a photograph taken from a film of 
Stepanek, not during an actual test, but only to record the proce- 
dure. (Why was only the procedure recorded, not the experiment?) 
If you study the picture you will see that the front edges of the 
jacket are slightly open, and Stepanek’s right index finger could eas- 
ily be inside the jacket. Naturally, he would not do this during the 
filming, but the photo is significant in showing that an inserted fin- 
ger would not be visible to the experimenter during the actual test. 

I found it enlightening to learn that Keil still thinks Ted Serios 
was a genuine psychic and that Honorton still believes Felicia moved 
that pill bottle by PK. Keil urges all parapsychologists to read my 
book. I hope that if they do they will judge it as a whole, and not 
fault it for one small inadvertent error about the length of a book 
bag! 


Martin Gardner 


110 Glenbrook Dr . 
Hendersonville , NC 28739 
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To the Editor: 

Gardner’s claim that “this is the only factual error in a book con- 
taining thousands of details” and “it concerns only a minor test 
which is described so briefly that we know nothing about the con- 
ditions under which Keil administered it” are false. In another test 
(Series 22) with jackets as targets and book mailing bags as con- 
tainers, highly significant results for the jackets were obtained when 
Pratt and Keil conducted the experiment (1969, p. 322). This pub- 
lication was cited by Gardner. Series 22 and Series 23 consisted of 
400 trials each. As I had indicated in my review (Keil, 1990) of 
Gardner’s book, Series 23 was conducted with a third experimenter. 
Series 23 had been selected by Pratt from all the research with Ste- 
panek as providing the best evidence for psi. Pratt (1973) had se- 
lected two publications for this distinction, and the three-experi- 
menter article (Pratt, Keil, & Stevenson, 1970) was one of them. 
This is what Gardner calls a “minor test.” 

The description of the test conditions which Gardner called brief 
included sufficient details in two publications (referred to above and 
also cited by Gardner) to show that the jackets could not be touched 
during the experiment when they were concealed in book mailing 
bags. In the three-experimenter test we had also referred to the po- 
sition of the open ends of the containers “which were always away 
from” Stepanek. Yet Gardner presented photos of a book mailing 
bag and of a jacket in a vertical position without informing his read- 
ers that this was not the way in which they were presented during 
the experiments. Book mailing bags were never used in a vertical 
position during experiments, and jackets were probably never used 
in this way either. Without re-reading all the earlier experimental 
reports I cannot say this with certainty as far as the jackets are con- 
cerned. None of the experiments in which I participated involved 
containers with target material in a vertical position. 

Gardner claims that Figure 3 in my review (1990, p. 157) shows 
that a finger touching the edge of a target would not be visible dur- 
ing an actual test. Stepanek handled the jackets by picking them up 
approximately at the middle of one side. If from this position he 
had tried to touch the target from the side (during tests when the 
flaps of the jackets were not closed) this would have been quite ob- 
vious as indicated in Figure 9 (p. 163). The black-and-white print of 
this photo may give the impression that perhaps two fingers were 
inserted between the flaps. In fact only the index finger is posi- 
tioned between the flaps, as is clear from the original color photo. 
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If Stepanek had tried to touch the target from the open end, he 
would have had to hold the jacket in an unbalanced way which 
would also have been quite obvious. Figures 6 and 8 (p. 161) show 
this with a book mailing bag as an example. Gardner ignores that 
any such moves would have had to be carried out about 100 times 
in 400 trials and within a very short time interval in order to obtain 
the significant results which Stepanek achieved. 

In his brief note Gardner provides us with two further examples 
of his misrepresentations. In my review I wrote, “Gardner repeat- 
edly refers to psi research not related to Stepanek, claiming that def- 
inite nonparanormal explanations have been found when in fact the 
questions remain open” (p. 151). I did not express any views as to 
whether I think that Ted Serios is a genuine psychic or not. Gard- 
ner also claims that Keil “urges all parapsychologists to read my 
book.” In fact I said, “I would still recommend that various para- 
psychological groups obtain a copy of the book to compare Gard- 
ner’s claim with my brief review and with the original publications. 
It is very likely that for many years to come pseudoskeptics will re- 
peat Gardner’s false claims that he has found a satisfactory nonpar- 
anormal explanation for Stepanek’s results” (p. 165). 
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